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Summary 

A new technique for locating simultaneous roots of a set of functions is described. The 
technique is based on the property of the Kreisselineier-Stcinhauser function which descends 
to a minimum at each root location. It is shown that the ensuing algorithm may be merged 
into any nonlinear programming method for solving optimization problems with equality 
constraints. 

Introduction 

The problem of locating function roots, and the related problem of satisfying equality 
constraints, arises often in engineering numerical analysis and optimization. In multi- 
function, multi- variable applications this problem tends to cause numerical difficulties, 
detrimental to both accuracy and computational efficiency. It is, therefore, of interest to note 
a new alternative for solution of the above problem based on the properties of a function 
that became known as the Kreisselmeier-Stcinhauser function after it was introduced in 
reference 1. The present paper defines the new, alternative algorithm and describes its 
applications as a tool for finding the function roots, and for solving nonlinear programming 
optimization problems with equality constraints. 

The KS Function and Its Properties Useful for Root-Finding 

The algorithm is based on the Kreisselmeier-Steinhauser function (KS function). The K S 
function is a differentiable envelope function for a set of functions of the form Y F k (X), 
fc = 1 ... NK . It is assumed that each of the above functions is continuous in X, but not 
necessarily continuous in its derivatives with respect to X . The K S function is expressed in 
two alternative but completely equivalent formats 

KS(F k ) = (1/p) In exp(p F k ) j , k = 1 ... NK (1) 

KS(F k ) = F max + (1/p) In cx l y ^ F k ~ ^inax))| , k = l ... NK (2) 

The format in equation (2) is recommended if the standard format in equation (1) generates 
too large values of the exponential function. 



The KS function has a property that 

Fmax. < KS(F k ) < F max + ln(NK)/p , k = 1 ... NK (3) 

where p is a user-controlled parameter. 

Example of the KS function is plotted in figure 1 for one independent variable and a set 
of three functions. As implied by equation (3), the user may draw KS closer to F m ax by 
increasing the value of parameter p and vice versa. In other words, the p parameter is a means 
for controlling how close the KS follows the piecewise envelope of the set of functions F k . 

JfT J^ S , funct . ion is . a differentiable equivalent of the non-differentiable “selective” function 
MAX(Ffc) available in many high-level programming languages. 

The KS function derivatives may also be expressed in two ways, corresponding to 
equations (1) and (2), respectively, 

^ = (x («p (* **» / E «p o> (4) 

dKS d F m&x fx—y „ _ QF U \ / 

axT = ~ax~ + (X 6X11 ip (Fk ~ Fm ™ )) Wc { ) / X exp (/) (F * “ W) (5) 

The KS function may be used as a tool for root finding because it has the following property 
defined using Z as a generic, single independent variable: 

“If a function F k (Z ) has a root F k (Z) = 0 for Z = Z r , the KS function of F k and 
Fh is at minimum at Z = Z r for any value of nonzero and nonnegative p. 55 

^ ie ^bove property is illustrated in figure 2 and may be proven as a theorem as 
follows. The property requires that the first derivative of KS{F k (Z), -F k (Z)) = 
(1/ p) In (exp(p F k ) + exp(-p F*)) with respect to Z vanish at Z = Z T . Considering that 




d(~F k ) 

dF k 

(6) 



dZ 

dZ 

differentiation of 

KS (F h - 

■F k ) yields 



dKS ( 
dZ ~ \ 

/ 

exp (p F k ) 

dF k 

dz exp (-p F k ) 

dz) / ( exp ^ F k) + ex P (-P F k )) 

(7) 

Since at Z = Z r , 
it follows that 

F k = 0 so 

that exp(p F k ) — exp (— p F k ) = 1 regardless of the value 

of p, 


dKS 

= 0 




dZ r 

(8) 


which proves the theorem. Generalization of the above to a function with several roots shows 
that the corresponding KS would have multiple minima. 

Extension to a set of functions F k (Z), k = l ... NK, in a hyperspace of NN dimensions 
(Z is then a vector of length NN) is straightforward owing to the property represented by 
equation (3). The previous theorem extended to the above general case is: 
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“The KS function of a function set made up of the original set of F k {Z ) functions 
and their negatives, —Fk(Z), (mirror images), 


KS(Z) = Ks{fi(Z), -Fi(Z), 

-F 2 (Z), ...F t (Z), 

has a local minimum at each point in the Z hyperspace where all the functions 
Fk(Z) attain zero value simultaneously.” 

The above can be proven by observing that differentiation of KS in equation (9) yields 
a derivative expression similar to equation (7) extended to include derivatives of all the 
(+F k , —Ffc) pairs, while equations (6) and (8) hold for each pair of derivatives. Thus, each 
point where KS attains minimum defines a solution Z r to a set of simultaneous equations 

F k (Zi) = 0; k = l ... NK ; i = 1 ... NN; (10) 


F 2 (Z), 

-F k (Z), ...F NK (Z), —F N k(Z) 


Numerical Example 

A numerical example illustrating the above is a set of two functions of two variables u 
and v: 

fl = -1 + (u - 3) 2 + (v - 2) 2 ; 

h = -1 + (u - 2) 2 + (u - l) 2 ; 

whose root locus plots in the u, v plane, shown in figure 3, are circles centered at the points 
(3,2) and (2,1), respectively. One solution of the set of two simultaneous equations f\ — 0, 
f 2 = 0 is the intersection point of the two circles at (2,2). The values of KS at that point 
and four neighboring points, (1.9,2), (2.1,2), (2,1.9), and (2,2.1), are given in table 1 for 
p = 50: 


Table 1. The KS values for p — 50 at, and in, 
the neighborhood of the intersection point (2,2) 


u 

1.9 

2.0 

2.1 

V 




1.9 

.2225386 

.1900034 

.1938629 

2.0 

.2100012 

.0277259 

.1900034 

2.1 

.2338629 

.2100012 

.2225386 
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Table 2 shows similar data for the other solution point, the intersection point (3.0, 1.0). 

Table 2. The KS values for p = 50 at, and in, 
the neighborhood of the intersection point (3,1) 


u 

2.9 

3.0 

3.1 j 

V 




0.9 

.2225386 

.2100012 

.2338629 

1.0 

.1900034 

.0277259 

.2100012 

1.1 

.1938629 

.1900034 

.2225386 


Both tables show well-defined minima of KS, the underscored values, at both solution 
(intersection) points. 


The Root Finding Algorithm 

Given the above KS function theorem, one may find a root of a set of functions F k (X) 
by solving the following unconstrained optimization problem 

“find X such that the objective function KS(Fk(X), —Fk(X)), 
k = 1 ... NK, is at minimum” 

Solution of the above problem will identify an X = X Q that renders all F k (X 0 ) = 0, 
^ = 1 • • NK, simultaneously. This problem may be solved by any technique of Nonlinear 
Mathematical Programming (NLP). The caveat is that a single execution of such technique 
will locate only one of, possibly, many different roots as a local minimum of the KS function. 
Fortunately, in engineering applications, the interest is usually limited to a few roots, and the 
subdomains containing these roots may be estimated by conjecture. Consequently, repetition 
of the optimization in equation (11) starting from initial points judiciously chosen in each 
such domain may be used to locate all the roots of interest. 


Satisfaction of Equality Constraints 

A standard optimization problem with inequality and equality constraints may be written 
as 

“find -X’opt such that objective function /(-^opt) 
is at minimum subject to constraints: 

f?j(-'^opt) ^0) j = 1 • ■ • MG; (12a) 

^p(-^opt) = V — 1 ••• MH;" (12b) 

Using the KS theorem introduced in the aforegoing, one may convert the above problem 
into one that includes only the inequality constraints 
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“find X Q pt such that objective function f(X Q p^) 
is at minimum subject to constraints: 

9j(X opt) ^ J = 1 • • • MG] 

KS ( VXopt), - M x opt)) < TOL, p = 1 . . . MH ; ” 

where TOL is a suitably small, positive tolerance. Any NLP technique may be used to 
determine X 0 p^ in the above problem that is, in general, easier to solve than the one in 
equation (12) because it includes no equality constraints. 

One may note that the KS function in equation (13b) is an extension of a cumulative 
constraint concept that was successfully used in conjunction with inequality constraints in 
many applications, e.g., reference 2, whereby a single KS function represented a number of 
constraints. Extending that concept further, both the inequality and equality constraints 
may be blended into one cumulative constraint, so that equation (13) transforms into 

“find X Q pt such that objective function /(X 0 p^) 
is at minimum subject to constraints: 

KS (^opt)> M*opt)> ~hp(X opt)^ — TOL , 

j = 1 ... MG, p= 1 ... MH-, ” 

Again, the presence of /i-constraints in the above may add to the number of the local 
optima that might already be present in the same problem with the inequality constraints 
only. Under the present state-of-the-art, there is no guaranteed way for locating the global 
minimum in this class of problems, except to repeat the optimization starting from several 
judiciously chosen initial design points. 

Conclusions 

A particular property of the Kreisselmeier-Steinhauser function known for its use as a 
cumulative constraint was identified as useful for locating roots of a set of functions. Based 
on that property, an algorithm was formulated for solving a general, nonlinear programming 
problem with inequality and equality constraints by transforming it into one with inequality 
constraints only. The transformed problem may be solved by any NLP technique capable of 
solving inequality constrained problems. 


(14) 

(14a) 


( 13 ) 

(13a) 

(13b) 
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